Prediction Interval: What to Expect When You’re Expecting … A Replication
نویسندگان
چکیده
A challenge when interpreting replications is determining whether the results of a replication "successfully" replicate the original study. Looking for consistency between two studies is challenging because individual studies are susceptible to many sources of error that can cause study results to deviate from each other and the population effect in unpredictable directions and magnitudes. In the current paper, we derive methods to compute a prediction interval, a range of results that can be expected in a replication due to chance (i.e., sampling error), for means and commonly used indexes of effect size: correlations and d-values. The prediction interval is calculable based on objective study characteristics (i.e., effect size of the original study and sample sizes of the original study and planned replication) even when sample sizes across studies are unequal. The prediction interval provides an a priori method for assessing if the difference between an original and replication result is consistent with what can be expected due to sample error alone. We provide open-source software tools that allow researchers, reviewers, replicators, and editors to easily calculate prediction intervals.
منابع مشابه
What to Expect When You’re Expecting: Fetal Protection Laws that Strip Away the Constitutional Rights of Pregnant Women
Many states have enacted fetal protection laws as a way of promoting fetal health and combatting the problem of in utero fetal drug abuse. These laws, however, unduly compromise the constitutional rights of pregnant women, implicating a woman’s rights to privacy, due process, and equal protection under the laws. Additionally, such laws compromise both maternal health and fetal health by discour...
متن کاملWhat Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science.
A recent study of the replicability of key psychological findings is a major contribution toward understanding the human side of the scientific process. Despite the careful and nuanced analysis reported, the simple narrative disseminated by the mass, social, and scientific media was that in only 36% of the studies were the original results replicated. In the current study, however, we showed th...
متن کاملHidden signals of climate change in intertidal ecosystems: What (not) to expect when you are expecting
متن کامل
What You Can’t Expect When You’re Expecting
It seems natural to choose whether to have a child by reflecting on what it would be like to actually have a child. I argue that this natural approach fails. If you choose to become a parent, and your choice is based on projections about what you think it would be like for you to have a child, your choice is not rational. If you choose to remain childless, and your choice is based upon projecti...
متن کامل